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(54) Queue and scheduled utilization metrics 



(57) An approach for measuring scheduler efficien- 
cy is disclosed. A scheduler (603) has metrics measure- 
ment capability, in which scheduler counters (803, 805, 
807, and 809) correspond to scheduling events. A coun- 
ter logic (801) selectively increments the scheduler 
counters (803. 805, 807, and 809). The counter logic 



(801) is coupled to queues (607) that store cells. The 
performance metrics are computed based upon values 
of the counters (803, 805, 807, and 809). The scheduler 
(603), according to one embodiment of the present in- 
vention, is deployed In a satellite communication sys- 
tem. 
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Description 

CROSS-REFERENCES TO RELATED APPLICATION 

5 [0001] This application is related to, and claims the benefit of the earlier filing date of, U.S. Provisional Patent Ap- 
plication (Application Number 60/210,865), tiled June 9, 2000, entitled "Scheduler Utilization Metrics," the entirety of 
which is incorporated herein by reference. Additionally, this application is relatedto U.S. Patent Application (Application 
Number 60/21 0,864), filed June 9, 2000, and entitled "Available Bandwidth Control Mechanism," which are incorporated 
herein by reference. 

10 

BACKGROUND OF THE INVENTION 
Field of the Invention: 

15 [0002] The present invention relates generally to communication systems, and is more particularly related to provid- 
ing congestion avoidance in a switching communication system. 

Discussion ot the Background 

^0 [0003] As businesses and society, In general, become Increasingly reliant on communication networks to conduct a 
variety of activities, ranging from business transactions to personal entertainment, these communication networks 
continue to experience greater and greater traffic congestion. For example, the maturity of electronic commerce and 
acceptance of the Internet as a daily tool pose an enormous challenge to communication engineers to develop tech- 
niques to reduce network latency and user response times. With the advances in processing power of desktop com- 

25 puters, the average user has grown accustomed to sophisticated multimedia applications, which place tremendous 
strain on network resources (e.g., switch capacity). Also, because the decrease In application response times is a 
direct result of the increased processor perfomnance, the user has grown less tolerant of network delays, demanding 
comparable improvements in the network infrastructure. 

[0004] Traffic control can be accomplished using two general approaches: flow control, and congestion control. Flow 

30 control seeks to regulate the amount of traffic that is transmitted from a source station to a destination station, by 
permitting the destination station to control the rate at which the source transfers data as to not overload the respective 
destination node. Flow control, however, does not directly address the problems associated with managing the traffic 
load on the network; for instance, numerous source stations can be communicating at rates that are acceptable to the 
destination stations. Nonetheless, the network (i.e., networking components) may not be able to sustain the overall 

35 level of traffic that is exchanged by these source and destination stations. It should be noted that these flow-control 
protocols, as with Transfer Control Protocol (TCP), tend to cause network congestion - rather than avoid network 
congestion - by collectively driving the network until it exhibits packet loss along with maximum queuing. 
[0005] Therefore, congestion avoidance schemes are needed to control the network traffic in a way as to effectively 
maintain the overall traffic that is introduced by the stations, which are generally connected via Intervening nodes. 

"to Without a congestion avoidance scheme, allarge queuing delay will occur, potentially resulting in dropped packets. 
Consequently, the quality of service of the system will likely be degraded. Also, because the switch is forced to drop 
packets, the useful capacity of the system is reduced; thus, the network service provider suffers a loss of revenue. 
[0006] One traditional approach to congestion avoidance is to upgrade the hardware to increase capacity to enhance 
the throughput of the system. The main drawbacks with this forklift approach are cost and potential lack of interoper- 

^5 ability. Further, in some systems, such as a communication satellite, hardware replacement is impractical. Furthermore, 
with wireless systems, additional frequency assignments may not be available. Another technique to avoid congestion 
involves the development of sophisticated networking protocols. One drawback with this approach is that the developed 
protocol may not be easily standardized; without industry acceptance, the development cost cannot be recouped. 
Another drawback is that the protocol is likely to be inefficient, requiring significant overhead bits to effect congestion 

50 control: this protocol inefficiency negatively impacts throughput of the network. 

[0007] Based upon the forgoing, there is a clear need for Improved approaches for the management of congestion 
to improve the traffic transmission efficiencies of networking components, and partteularly. those components that arc 
subject to potential traffic congestion. 

[0008] Accordingly, it Is highly desirable for the network to control the traffic that enters the network to avoid conges- 
ts tion and to maximize the effective network throughput without introducing excessive protocol overhead cost. 

[0009] Congestion avoidance optimizing switching system performance is highly desirable. In this regard, both the 
metrics that are used in monitoring the traffic flow as well as the algorithms that are used to process these metrics are 
of significant Interest. 
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SUMMARY OF THE INVENTION 

[001 0] According to one aspect of the invention, a method Is provided for measuring scheduler efficiency. The method 
includes selectively incrementing a plurality of scheduler counters corresponding to a plurality of scheduling events. 

5 The method also includes computing performance metrics based upon values of the plurality of scheduler counters. 
Under this approach, congestion avoidance is provided, while increasing effective throughput. 
[0011] According to another aspect of the invention, a scheduling device having metrics measurement capability 
comprises a plurality of scheduler counters corresponding to a plurality of scheduling events. A counter logic is con- 
figured to selectively increment the plurality of scheduler counters; the counter logic is coupled to a plurality of queues 

10 that store packets. The performance metrics are computed based upon values of the plurality of scheduler counters. 
The above arrangement advantageously enhances system efficiency. 

[0012] In yet another aspect of the Invention, a switching system comprises a plurality of input ports that are config- 
ured to receive packets. A plurality of output ports communicate with a plurality of destination sites. A plurality of queues 
are coupled to the input ports and the output ports for storing the received packets. A scheduler is coupled to the 

'5 plurality of queues and is conligured to assign the stored packets for transmission out the output ports. The scheduler 
comprises a plurality of scheduler counters corresponding to a plurality of scheduling events, and a counter logic that 
is configured to selectively Increment the plurality of scheduler counters. A processor is configured to compute per- 
formance metrics based upon values of the plurality of scheduler counters. Under the above arrangement, a dynamically 
adaptive congestion mechanism Is provided. 

20 [001 3J In yet another aspect of the invention, a computer-readable medium carrying one or more sequences of one 
or more instructions for measuring scheduler efficiency is disclosed. The one or more sequences of one or more 
instructions include instructions which, when executed by one or more processors, cause the one or more processors 
to pert omn the step of selectively incrementing a plurality of scheduler counters corresponding to a plurality of scheduling 
events. Another step includes computing pcrfonmancc metrics based upon values of the plurality of scheduler counters. 

25 This approach advantageously improves efficiency of a switching communication system that has transmission con- 
straints. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 [0014] A more complete appreciation of the invention and many of the attendant advantages thereof will be readily 
obtained as the same becomes better understood by reference to the following detailed description when considered 
in connection with the accompanying drawings, wherein: 

Figure 1 is a block diagram of a switch with congestion avoidance capability, in accordance with an embodiment 
35 of the present invention; 

Figure 2 is a diagram of a communication network that utilizes the switch of Figure 1 ; 

Figures 3A and 3B are diagrams of a satellite communication system with congestion avoidance capability, ac- 
cording to an embodiment of the present invention; 

Figure 4 is a diagram of an interference region of a target downlink cell, in accordance with an embodiment of the 
^0 present invention; \ 

Figure 5 is a diagram showing the interaction among the satellite terminals (STs), the satellite, and the Network 
Operations Center (NOC) in a satellite communication system, in accordance with an embodiment of the present 
invention; 

Figure 6 is a diagram of an available bandwidth control mechanism (ABCM) utilized in the system of Figure 5; 
^5 Figure 7 is a flow chart of the operation of the available bandwidth control mechanism of Figure 6; 

Figure 8 is a diagram of the scheduler of Figure 5 utilizing four counters; 

Figure 9 is a flowchart of the scheduler monitoring operation, according lo an embodiment of the present invention; 
Figure 10 is a flowchart of the metric collection process using the counters of Figure 8, according to an embodiment 

of the present invention; and 

50 Figure 11 is a diagram of a computer system that can perform the functions of the ABCM to avoid congestion, in 

accordance with an embodiment of the present Invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

55 [0015] In the following description, for the purposes of explanation, specific details are set forth in order to provide 
a thorough understanding of the invention. However, it will be apparent that the invention may be practiced without 
these specific details. In some Instances, well-known structures and devices are depicted in block diagram form in 
order to avoid unnecessarily obscuring the invention. 
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[0016] The present invention acconnplishes congestion avoidance by using a scheduler that collects bandwidth met- 
rics and transmits these metrics to a traffic control processing logic. A scheduler has metrics measurement capability, 
in which scheduler counters correspond to scheduling events. A counter logic selectively increments the scheduler 
counters. The counter logic is coupled to queues that store packets. The performance metrics are computed based 

5 upon values of the counters. The above approach provides for an enhanced bandwidth allocation scheme. The input 
to these queues may also be monitored by counters to further enhance the transient perf omnance of the control system. 
[0017] Figure 1 shows a functional block diagram of a switch with congestion avoidance capability, according to an 
embodiment of the present invention. Switch 100 includes multiple input ports 101 that receive incoming traffic from 
one or more source nodes (not shown) and forwards the traffic to a bandwidth control processor 103. A congestion 

10 avoidance logic 1 05 within switch 1 00 operates in conjunction with the bandwidth control processor 1 03 to control the 
amount of traffic entering input ports 101. A packet buffer 107 stores packets from input ports 101 that have been 
accepted for transmission by the bandwidth control processor 103. The stored packets in packet buffer 107 are trans- 
mitted to a scheduler 109. which communicates with a constraint check logic 111 to determine whether the stored 
packets conform with established transnhission constraints. Scheduler 109 examines the destination addresses of the 

15 packets that are stored in packet buffer 1 07 using a round-robin scheme and fonwards such packets to an appropriate 
output port among the various output ports 113. The congestion avoidance functionality of switch 100 is described 
below with respect to Figure 2. 

[0018] Figure 2 shows a communication network that utilizes a switch with congestion avoidance functionality, in 
accordance wilh-an embodlmenl of the present invention. A communication network 200 includes multiple source 

20 stations 201 that generate traffic to node 203, which can be any networking equlpment that transfers data. In an ex- 
emplary embodiment, node 203 is an Internetworking device, such as a router; alternatively, node 203 may be any 
type of gateway in a land-based or satellite-based communication system. Node 203 is connected to an input port 
(Figure 1) of switch 100. Although not shown, additional nodes, such as node 203, may be connected to additional 
ports 101 of switch 100. The output ports (Figure 1) of switch 100 connects to multiple nodes 205, which can be the 

25 same networking component as that of node 203. As shown, each of the nodes 205 can potentially communicate with 
numerous destination stations 207 within region 209 (e.g., sub network). For example, if nodes 205 are routers, the 
routers would have multiple output ports designated for region 209. 

[0019] As indicated previously, the conventional communication network exhibits perfonnance characteristics that 
are dictated largely by the hardware limitations of switch 1 00. In other words, the throughput of the network 200 depend 

30 on such parameters as buffer size and processing capability of switch 100. In some practical systems, however, the 
communication network 200 possess network bottlenecks at points in the network other than the switch 100. For ex- 
ample, assuming that for security reasons, destination stations 207 within region 209 cannot simultaneously receive 
packets, consequently switch 100 may need to buffer some of the packets until the first set of packets are delivered 
to the particular destination stations 207. Thereafter, the buffered packets within switch 100 can be delivered to the 

35 destination stations 207 within region 209. From this example, It is clear that the buffering of the packets within switch 
100 can result in system performance that does not depend on the hardware capabilities of switch 100. but instead on 
the network constraints associated with region 209. 

[0020] The above scenario Is characteristic of a satellite communication system. For the purposes of explanation, 
the operation of congestion avoidance according to an embodiment of the present invention, is discussed with respect 

40 to a satellite communication system with transmission constraints to downlink cells. However, it should be noted that 
the approach has applicability to many other switching systems, as recognized by one of ordinary skill in the art. For 
example, the switching systems may include an ATM (Asynchronous Transfer Mode)/SONET (Synchronous Optical 
Network) network, a Gigabit Ethernet network, and a voice network. The end stations of these systems are referred 
to as destination sites. Accordingly, the destination sites in a satellite system would be downlink cells. 

45 [0021] Figures 3A and 3B show a satellite communication system with an on-board switch, In accordance with an 
embodiment of the present invention. The satellite payload 301 has a switch 302 that is connected to multiple trans- 
millers 303; thai is, N Iransmillers. Switch 302 includes a congestion avoidance logic 304, a bandwidth control proc- 
essor (BCP) 305, a packet buffer 307, a downlink scheduler 309, and a constraint check logic 311 . One of ordinary 
skill in the art would recognize that the congestion avoidance logic 304, bandwidth control processor (BCP) 305, down- 

50 link scheduler 309, and constraint check logic 31 1 may be implemented via software, hardware (e.g., general processor, 
an Application Specific Integrated Circuit (ASIC), etc.), firmware or a combination thereof. As shown, the BCP 305 is 
a part of switch 302. Alternatively, the BCP 305 may be implemented as a separate processor that is separate from 
switch 302 (as shown in Figure 6). 

[0022] In switching communication system 300, satellite temninals (ST) (not shown) originate traffic from a coverage 
55 area 315. The generated traffic from the STs is transferred through switch 302 and terminate at destination STs (not 
shown) within coverage area 317. It should be noted that the destination STs can be within the same coverage area 
315 as the originating STs. To effectively transmit traffic to the desired destination ST through switch 302, source STs 
transmit bandwidth requests to the bandwidth control processor 305 prior to transmitting any data traffic. 
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[0023] A connection that is established between a source ST and a destination ST is controlled by the BCP 305 and 
a network operation center (NOC). The NOC (shown in Figure 5), which is based on the ground, provides management 
functions for the system 300. An ST needs to obtain authorization from the NOC before making a request to the BCP 
305. However once an ST has received authorization from the NOC, the ST is likely to receive a rate allocation from 

5 the BCP 305 because the NOC keeps track of the total uplink (and downlink) bandwidth available for connections and 
will block a connection request if there is Insufficient satellite capacity available to satisfy the request. 
[0024] A major advantage of a congestion avoidance mechanism of system 300 is that if a connection request is 
blocked because of impending congestion in the switch 302, the connection may be given an alternate path for con- . 
nection, should one exist., rather than admitting the connection to the switch 302 and potentially deteriorating the grade 

10 of service for both the connection and previously admitted connections. Consequently, the congestion avoidance mech- 
anism of system 300 allows commitment to a quality of service for those connections that are admitted. A key source 
of congestion In the system 300 lies with the downlink channels 321, Accordingly, the bandwidth control processor 
(BCP) 305 implements the bandwidth control function which includes controlling the allocation of uplink channels and 
timeslots and mitigating downlink congestion. Bandwidth control processor 305 examines the requested bandwidth 

^5 and replies with grants based on downlink resource availability, as determined by congestion avoidance logic 304 and 
uplink resource availability. As will be explained in greater detail later congestion avoidance in the system 300 Is 
achieved by the collaboration of bandwidth control processor 305, congestion avoidance logic 304, a scheduler 309, 
and a traffic control processing logic (613 of Figure 6) to regulate the amount of traffic received by the switch 302 
through TDMA (^me Division Multiple Access)/FDMA (Frequency Division Multiple Access) uplink channels 319 via 

20 request/grant bandwidth control processes. The present invention concentrates on the interaction between the sched- 
uler 309 and the traffic control processing logic, which are more fully described in Figures 5-7. 
[0025] The service areas 315 and 317 are covered by a set of polygons that are fixed on the surface of the earth. 
Downlink polygons, called microcelts, are hexagonal in shape as viewed from the spacecraft, with seven microcells 
clustered together to form an uplink polygon, called a cell. As used herein, the term microccll is used synonymously 

25 with the term downlink cell. The satellite generates a set of uplink circular beams that each encloses a cell. It also 
generates a set of downlink beams that each encloses a microcell. 

[0026] Up to 12 downlink spot beams can be transmitted simultaneously on each of two polarizations subject to 
minimum microcell separation distance limitations. Beams on the same polarization must be sufficiently separated 
spatially to avoid unacceptable co-channel interference. Another co-polarized beam is not allowed to transmit to another 

30 microcell within an ellipse or else excessive interference may occur The "keep-out" areas apply separately and inde- 
pendently for the two polarizations; the link budgets account for any cross-polarization interference that may occur 
[0027] As shown in Figures 3A and 38, on the downlink of communication system 300, at each TDMA transmission 
slot, the downlink scheduler 309 selects up to n bursts of packets from M virtual queues of the packet buffer 307 to 
transmit through n transmitters, based on the scheduling algorithm and transmission constraint checks. The scheduling 

55 algorithm, in an exemplary embodiment, is a round-robin scheme. Sometimes the downlink scheduler 309 may not be 
able to find n bursts to transmit due to transmission constraints, in which case aggregate downlink transmission capacity 
will be limited by the transmission constraints. The downlink congestion in communication system 300 occurs when 
the amount of traffic admitted to the switch 302 exceeds the capacity of the downlink. In other words, if the BCP 305 
made uplink allocations simply based on the availability of uplink slots, the BCP 305 would sometimes admit more 

■^0 traffic to a particular downlink ceil (i.e. , destination site) or cluster of mutually-interfering microcells than the downlink 
can carry. Consequently, the data packets for these areas would completely fill the packet buffer 307 in the payload's 
switch 302, resulting in dropped packets. Therefore, the availability of both uplink slots and downlink bandwidth factor 
Into bandwidth allocations that is performed by the BCP 305. 

[0028] The main transmission constraint in communrcation system 300 is the Interference constraint; that is, two 
^5 simultaneous downlink transmissions cannot be performed if they are directed at downlink cells which are within a 
system limit interference distance. In Figure 3B, because downlink cells A, B and C in coverage area 31 7 are outside 
the system limit interference distances (as shown by the overlapping circles) from one another, the satellite can simul- 
taneously transmit packets to these downlink cells A, B and C. However, simultaneous transmission cannot be directed 
to downlink cells D and A, downlink cell D and B, downlink cell E and B and downlink cell E and 0 since they are within 
50 the system limit interference distance. That Is, these downlink cells are In the same circle. 

[0029] To Illustrate the downlink capacity limitation of the system 300 stemming from transmission constraints (in 
particular interference constraints), a scenario in which there arc packets in the virtual queues of packet buffer 307 
that are destined only to downlink cells A, B, C, D and E Is considered. It should be noted that without any constraint, 
there can be five transmissions at one TDMA slot; however, with the interference constraint, only a maximum of three 
55 transmissions at one TDMA slot is possible (to downlink cells A, B, and C). If the satellite is to transmit to downlink cell 
D or downlink cell E, there can be at most two transmissions only, either to downlink cells D and C or to downlink cells 
E and A. 

[0030] Figure 4 shows a diagram of an interference region of a target downlink cell defined according to an embod- 
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iment of the present invention. An interference region 400 includes a target downlink cell, which is surrounded by 
numerous downlink cells 401. Downlink cells 401 are clustered around target downlink cell )^ within a radius that is 
determined by an angle x from the point of view of a satellite. The angle xcan be set to any degree, depending on the 
coverage area and network application. 

5 [0031] As will be discussed in more detail below, the BCP 305 and the congestion avoidance logic 304 limits the 
aggregate traffic going to a sets of downlink cells, referred to as an "interference cluster", instead of limiting the traffic 
going to each individual downlink cells. An interference cluster is a maximal set of downlink cells that are within the 
system limit interference distance from one another. Since clusters are not mutually exclusive of one another, a downlink 
cell can belong to more than one cluster.- 

10 [0032] According to one embodiment of the present invention, two types of requests for bandwidth allocation are 
defined: rate requests, and volume requests. In general, rate requests are utilized for connection-oriented traffic, while 
volume requests are used to transmit bursty traffic. In particular, rate requests specify the number of slots in each 
uplink frame that an ST needs to meet the uplink dennands for a relatively constant traffic (e.g., connection-oriented). 
A rate request results in the allocation of a constant number of slots each frame, spread out as evenly in time as 

15 possible, which the ST can use to send packets at a constant rate. The requesting ST gets a constant allocation of 
that uplink capacity every frame until the request is cancelled by the ST via a de-allocation message to the satellite. 
[0033] Volume requests specify the number of uplink slots that an ST requires to send a specific number of packets 
to another ST The requesting ST receives a periodic allocation of zero, one or many slots within a specific frame until 
the entire number of slots requested has been allocated. Volume requests are used by the ST to send a burst (one or 

20 many) of data packets on the uplink. Several volume requests may be transmitted by-the ST In a short period of time 
to send a file that has hundreds of data packets (e.g., segmented IP (Internet Protocol) packets) to another ST. 
[0034] Figure 5 shows the interaction among the satellite terminals (STs), the satellite, and the Network Operations 
Center (NOC) in a satellite communication system, in accordance with an embodiment of the present Invention. As 
shown, a satellite communication system 500 includes STs 501 503, a satellite 505, and a NOC 507. For explanatory 

25 purposes, only the transmit section of a source ST and the receive section of a destination ST are shown. Accordingly, 
the ST 501 is a transmitting ST while ST 503 is designated as a receiving ST Each of the STs 501 and 503 has an 
interface 501 b, 503bj respectively, for interfacing with an external network (not shown) and the satellite to control the 
traffic flow. Specifically, traffic from the external network (not shown) enters an input access 501b of the transmitting 
ST 501 and is transmitted to an uplink to the satellite 505. The satellite 505 forwards the traffic to the receiving ST 503 

30 via the downlink. The traffic egresses an output access 503b of the receiving ST 503 to another network (riot shown). 
[0035] User traffic is received by the input access 501 b of the transmitting ST 501 , where It Is stored and processed 
(e.g., segmentation of IP (Internet Protocol) frames). As previously discussed, for volume traffic the transmitting ST 
501 makes bandwidth-on-demand (BoD) requests to a bandwidth control processor (BCP) 509. In turn, the BCP 509 
selectively issues BoD grants that specify an uplink assignment, If It Is determined that both uplink and downlink band- 

35 widths are available. For rate traffic, the transmitting ST 501 makes traffic requests to the NOC 507, for which the NOC 
507 authorizes according to the uplink and downlink bandwidths that are available. If so authorized, the transmitting 
ST 501 makes a rate BoD request to the BCP 509 to obtain a specific uplink assignment. 

[0036] If transmitting ST 501 possesses a dedicated uplink assignment (i.e., rate request) such that the ST 501 does 
not employ BoD requests to the BCP 509 to send traffic, the ST 501 is considered a high-volume uplink (HVUL) ST. 

"^0 That Is, an active HVUL ST 501 already ha^ uplink bandwidth assigned by the NOC 507. For any significant change 
In traffic demand in HVUL traffic (to a specific destination), the ST 501 makes traffic rate adjustment request to the 
NOC 507, for whrch the NOC 507 provides authorization according to the downlink bandwidth that Is available. 
[0037] Traffic sent the uplink might be dropped in the satellite 505, if the switch queue 51 1 Is experiencing congestion 
for a particular microcell. This operation is based upon both queue utilization and the priority level of the specific traffic 

^5 Involved. If the traffic Is not dropped, the traffic will be queued In the switch queue 51 1 for transmission via a downlink 
to the microcell that contains the destination ST 

[0038] In the system 500 of Figure 5, every 21 ,7 \isec, a downlink scheduler 513 assigns up to 24 bursts of traffic 
(e.g., each burst may be 12 packets) to the downlink spot beams. As previously discussed, a significant potential 
source of congestion is that the scheduler 51 3 needs to make these assignments to geographically disperse locations 
50 in order to avoid interference between neighboring microcells (i.e., transmission constrained, in part, because of inter- 
ference considerations). If downlink congestion occurs, the queues 51 1 rapidly fill up and overflow, resulting In dropped 
packets. 

[0039] The STs 501 and 503 support numerous application protocols, as represented by the Input access 501b and 
output access 503b, in addition to utilizing set of networking protocols that are required to communicate with the external 
55 network (not shown). However, for switching efficiency, as with Asynchronous Transfer Mode technology, the network 
500 employs a common packet size from the backbone interface (BBIF) 501a through the satellite 505 to the BBIF 
503a. As a result, segmentation and reassembly (SAR) of the various protocol data units cannot be avoided. Effective 
throughput depends on the success of this SAR process, giving rise to the concept of "good" throughput ("goodput") 
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and "bad" throughput ("badput"). 

[0040] The effective throughput Is the amount of traffic that exits the network and is useful to the end application. 
Goodput is a metric for evaluating this effective throughput. The minimum criteria for goodput is the number of suc- 
cessfully reassembled packets: goodput may also include end application effects as appropriate, such as TCP (Trans- 
5 mission Control Protocol) windows. For example, assuming that an IP packet is segmented into 15 segments at the 
transmitting ST 501, if alt 15 segments are successfully recombined at the receiving ST 503, then all 15 segments 
contribute to goodput. However if one segment is lost (e.g., during for overflow of queues 511), then without a reliable 
link protocol (RLP), there is zero goodput tor the IP packet. 

[0041] Badput Is that portion of the downlink traffic that is not useful to the end application, in particular that which 

10 does not get successfully recombined at the receiving ST 503. Continuing with the above example, if one segment Is 
lost, then, without RLP, there are 14 segments of badput for the IP packet. With standard TCP/IP, the whole TCP 
window would constitute badput when a single segment Is lost. The units for goodput and badput are the same as that 
used for throughput; further these parameters may also be expressed as a percentage of the total throughput. 
[0042] The switch (not shown) within the satellite 505 supports a packet drop priority scheme, In which the BCP 509 

^5 implements drop thresholds, which limit the number of packets entering the queues 51 1 . In an exemplary embodiment, 
tour drop priorities are implemented to determine the order in which packets will be dropped during congestion. Priority 
0 is assigned to the highest priority traffic and would be the last type of packets to be dropped. Priority 3 is assigned 
to the lowest priority traffic and would be the first type of packets to be dropped. Before uplink transmission, the trans- 
milllng ST 501 nFwrks packets as one of these four drop priorities. 

20 [0043] The queues 511 , which in an exemplary embodiment are logical, correspond to the microcells; the queues 
511 store traffic on a burst basis (e.g., In groups of 12 packets). In an exemplary embodiment, for each one of the 
queues 511, a pair of thresholds (I.e., a drop maximum ("drop max") and a drop minimum {"drop min")), which corre- 
spond to each of the four priorities, restrict the number of packets that are stored In the queues 511. When^he number 
of bursts In a queue 51 1 exceeds the drop max threshold for a given priority, the packets in the priority arc dropped as 

2S they are demodulated from the uplink. Packets continue to be dropped until the traffic falls below the drop min threshold. 
If congestion persists, packets are dropped based upon the associated thresholds of the other priorities. Utilizing both 
a drop max and a drop min provides for a hysterlsis in queue occupancy that "bunches" packet dropping. This capability 
is useful in reducing the generation of badput. Badput is also minimized by accounting for the utilization and available 
bandwidth of the microcells via the scheduler 513, in accordance with the present Invention. 

30 [0044] The scheduler 513 generates messages that contain utilization metrics to the NOC 507. According to one 
embodiment of the present invention, for each microcell, the scheduler 51 3 employs two counters (not shown) to gather 
bandwidth metrics associated with the utilization and available bandwidth of the microcell. These counters are denoted 
as follows: a "Yes" counter that tracks the number of times that an assignment was made for a specific microcell, and 
a "No"counter that tracks the number times a queue 511 was examined for assignment, but had no traffic to send. The 

35 counter values of both counters are sent to the NOC 507 after every measurement period; e.g., every super frame 
(786 msec). 

[0045] The computation of the traffic statistics can be performed within the satellite 500, in which case the message 
that is sent to the NOC 507 would include these computed traffic statistics. Alternatively, a processor 508 within NOC 
507 can compute the traffic statistics from the counter values that are received from the scheduler 513, as follows: 
40 . \ 

Carried Load ^ Yes Eq.(1) 
43 Remaining Available Bandwidth = No Eq.(2) 

Total Available Bandwidth = Yes + No Eq (3) 



50 



Percent Utilization = Yes / (Yes + No) Eq.(4) 



In Eq. (1), the Carried Load is equated with the Yes counter value. The Remaining Available Bandwidth, as seen in 
Eq. (2), equals the No counter value. The Total Available Bandwidth (Eq. (3)) Is detemiined based upon the sum of 
55 the Yes and No counter values. The Percent Utilization, as seen In Eq. (4), is equal to the Yes counter value divided 
by the sum of the Yes and No counter values. It is observed that the utilization of Eq. 4 is responsive to both changing 
carried traffic, as given by the Yes counter value and to changing available bandwidth, as given by the Yes and No 
counter values. The NOC 507 processes the above bandwidth metrics and detemnlnes the bandwidth that is available 
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to each microceK. Then, according to service demands and policy rules, it apportions this bandwidth to the traffic 
classes: rale, HVUL, and volume. 

[0046] For volume traffic, the NOC 507 determines a threshold for each microcell that the BCP 509 should not exceed 
in granting BoD requests for that destination during a bandwidth allocation period (96 msec). These thresholds are 
5 set to minimize packet dropping, while not under utilizing available bandwidth. For each bandwidth allocation period, 
a BoD request for a microcell may be reduced or denied If making the grant with the others already granted would 
cause the traffic to exceed the threshold specified for the cell. It Is noted that at the start of the bandwidth allocation 
period, pre-existing rate grants are immediately subtracted from the thresholds, with only the remainder being available 
for volume traffic. 

10 [0047] An additional consideration arises from the fact that the BCP 509 has finite processing power. During periods 
of high traffic demand, the number of BoD requests to the BCP 509 may be significantly beyond the capacity of the 
BCP 509 to process them. Accordingly, a mechanism Is provided for the transmitting ST 501 to throttle back the volume 
BoD requests to the BCP 509. The BCP 509 determines its utilization, which Is periodically sent in control messages 
to the NOC 507, alerting the NOC 507 about the level of BCP congestion. 

15 [0048] As a result, NOC 507 sends these control messages to. the transmitting ST 501 to reduce ST BoD requests 
during periods of BCP congestion. The ST 501 may then be responsive to the reduction in its BoD requests - without 
potential loss of traffic - by simply aggregating more traffic for each request. This operation is generally easy to achieve 
during periods of high traffic demand. The transmitting ST 501 receives the BoD thresholds (an other bandwidth control 
parameters) Uom the NOC 507, and receives the bandwidth requests from the input access 501b. Then, for each cell 

20 that the ST 501 has traffic to send to, a BoD regulator 501c deteimines the actual BoD requests that are to be sent up 
to the BCP 509 for that celt. A BoD controller 501 d within the transmitting ST 501 Initiates the BoD requests to the BCP 
509. Although shown separately, the BoD regulator 501c may be integrated with the BoD controller 501 d. 
[0049] Figure 6 shows a diagram of the available bandwidth control mechanism (ABCM) utilized In the system of 
Figure 5. A satellite communication system 600 includes numerous transmitting STs) (not shown), which offer traffic 

^5 606 to a satellite 601. In turn, the satellite 601 forwards the traffic 608 to the appropriate receiving STs (not shown). It 
should be noted that all STs possess the capability to transmit and receive traffic (as mentioned previously); therefore, 
the labels, transmitting ST and receiving ST, pertain to the mode of operation of an ST at a particular time instance. 
The traffic reaches the receiving STs by downlink spot beams, which are electronically steerabte by the satellite 601 
to an earth surface area designated as a microcell. 

30 [0050] Although possessing high bandwidth (for example, 450 Mbps), due to practical limitations of communications 
satellite design, the satellite 601 utilizes a relatively low number of spot beams when compared with the number of 
microcells. In an exemplary embodiment, the satellite communication system 600 has 1 200 microcells, and the satellite 
supports 24 spot beams. Accordingly, the spot beams are time shared among the microcells. This is accomplished by 
a scheduler 603. The scheduling process is performed as required, in light of the fact that the receive traffic requirements 

35 of the various microcells may vary by a considerable amount, and that there may be competition among the microcells 
for available scheduler bandwidth. The scheduler 603 provides a self-monitoring function to output scheduler bandwidth 
metrics; for example, by utilizing the Yes and No counters, as discussed previously. 

[0051] The satellite 601 provides temporary storage of traffic (i.e., packet bursts), which await assignment by the 
scheduler 603 to a destination microcell. The traffic storage is provided by a switch 609, employing separate (logical) 

"^0 queues 605 that correspond to the individuahmicrocells. It Is recognized by one of ordinary skill in the art that any type 
of switches can be used; e.g., cell-based switches and frame-based switches. That is, the queues 605 store the traffic 
that are received from the transmitting STs (not shown). The scheduler 603 serves the queues 607 of the switch 609. 
Within the satellite 601. a Bandwidth Control Processor (BCP) 611, as previously discussed, regulates the granting 
and denial of bandwidth requests from the transmitting STs, thereby limiting the amount of traffic that the switch 609 

45 processes. 

[0052] During busy periods for the system 600, the traffic demand to some microcells may greatly exceed the capacity 
of the microcell to receive traffic. Without traffic control to mlllgale this silualion, the queues 607 for such microcells 
would quickly fill and overflow, causing the switch 609 to become congested for those microcells and to drop packets. 
This congested state of the switch 609 negatively impacts system performance. 
50 [0053] Thus, it is highly desirable that such switch congestion be avoided, and that the transmitting STs be given the 
opportunity to shed excess traffic gracefully. Another concern is that the amount of bandwidth that is available for 
potentially congested microcells is likely to vary dynamically due to competition and potential interference with other 
microcells. 

[0054] Consequently, the satellite communication system 600 employs a traffic control processing logic 613, The 
55 interaction between the traffic control processing logic 61 3. the scheduler 603, and the BCP 61 1 constitutes an Available 
Bandwidth Control mechanism (ABCM) that can dynamically adapt to traffic conditions to avoid congestion within the 
satellite communication system 600. As shown in Fig. 6, the traffic control processing logic 613 is located external to 
the satellite 601 : for example, the traffic control processing logic 613 may reside in a NOC 507 (Figure 5). In a system 
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in which processing resources are a concern, implementing the traffic conlrol processing logic 613 at a site rennote 
from the satellite 601 would be preferable, so that the processing and power resources of satellite 601 can be utilized 
for other functions. However depending on the specific application of the satellite communication system 600, the 
traffic control processing logic 61 3 may alternatively be housed within the satellite 601 . In other words, the traffic control 

5 processing logic functions may be placed within the satellite 601 or within a ground-based center (e.g., NOC). 

[0055] For explanatory purposes, Figure 6 illustrates an embodiment in which the traffic control processing logic 613 
is placed in the NOC 507 (Figure 5). The ABCM, of which the traffic control processing logic 61 3 is a key part effectively 
provides a real-lime traffic control loop. The traffic control processing logic 613 includes a microcell utilization module 
615 for determining utilization, an error calculation module 617 for comparing the computed utilization with a target 

10 utilization, a gain and filtering module 619 for computing a correction value, an adder 621 for outputting a control value, 
and a control storage 623 for storing the control values. It is known to the art that congestion avoidance operation may 
be obtained by controlling traffic admittance to the network such that the determined utilization is less than 100%= and 
herein specifically that It should approximate the designated target utilization. The operation of the traffic control 
processing logic 613 is more fully described with respect to Figure 7. 

15 [0056] Figure 7 shows a flow chart of the operation of the available bandwidth control mechanism (ABCM) of Figure 
6. For a given measurement period, the scheduler 603 monitors the traffic that is assigned for transmission to a mi- 
crocell gathering the metrics associated with the observed traffic that is processed from the queues 607. In an exem- 
plary embodiment, the metrics are the counter values of the Yes counter and the No counter, as described above with 
respect to Figured. The counters are incremented from Ihe start of a measurement period until the period expires; the 

20 measurement period can be set to any prescribed time interval, depending on the desired response of the traffic control 
processing logic 613. At the completion of a measurement period, the scheduler 603, as in step 701, provides the 
collected bandwidth metrics on each microcell of interest to the traffic control processing logic 613. These metrics are 
formulated in a message and sent to the traffic control processing logic 61 3 by the satellite 601 , where they are received 
by a utilization module 615. In step 703. the utilization module 615 determines the utilization of each microcell. In 

25 particular, based on the received bandwidth metrics, the utilization module 615 calculates utilization for each microcell 
as follows: 

Utilization = Carried / (Carried + Additional), Eq.(5) 

30 

where Carried represents the actual traffic transmitted to a microcell and Additional represents available but unused 
bandwidth. The units of the Carried and Additional parameters may be any convenient, consistent units; e.g., megabits- 
per-second, kilo-packets-per-second (kpps), or bursts-per-mitlisecond. 

[0057] It Is recognized by one of ordinary skill in the art that Eq. 5 and the ABCM equations based upon Eq. (5) have 
35 general utility. When embodied into a system, such as system 500, which utilizes a scheduler 613, providing Yes and 
No counts, the specific implementation of Eq. (5) reduces to that of Eq. (4). 

[0058] For each microcell.. there is a target utilization, which is a parameter that may be fixed or may be adaptive to 
general traffic conditions. To avoid congestion and possible packet loss, the utilization for any microcell should be less 
than 100%. Accordingly, the target utilization may initially be set to a default value of, for example, 95%, and may 
40 subsequently be tailored to reflect the traffic*pattern corresponding to the particular microcell. In step 705, the error 
calculation module 61 7 computes the difference (or error) between the computed utilization and a corresponding target 
utilization for each microcell according to the following equation: 

^3 Error = Target - Utilization, Eq.(6) 

where Error and Target are dimensionless fractions. Alternatively, the Error may be expressed in traffic units, as follows: 

50 Error = (Target/1 00) * (Carried + Additional) - Carried Eq.(7) 

[0059] For computational efficiency, the above Error value is formulated to exhibit the same polarity as that of the 
Correction value (i.e., all positive values or all negative values). Next, in step 707, the error calculation module 617 
detemiines whether or not the difference between the computed utilization and the corresponding target utilization is 
55 within a predetermined range (e g., 3% variation). If the utilization of a particular microcell matches the Target value 
or falls within the predetennined range, then zero error is determined. If the difference falls outside the predetermined 
range, then the Correction value, as in step 709. is determined. For each microcell, any significant error is passed on 
to the gain and filtering module 619, which determines the correction value. 
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[0060] According to an exemplary embodiment, the difference represents the correction value (or error value): the 
direct use of the Error value as the Correction value produces a unity loop gain. 

[0061 ] Although the Error value may be directly used as the Correction value, It is often desirable to employ additional 
processing. The bandwidth metric values from the scheduler 603 may exhibit noisy fluctuations, especially if the meas- 
5 urement periods are of short durations. In this case, it may be desirable for module 619 to employ mechanisms for 
filtering and/or smoothing of the measurement samples. 

[0062] Additionally, It may be desired to deliberately slow the response of the traffic control loop of the ABCM, in 
which case the gain and filtering module 619 of the traffic control processing logic 613 may employ an algorithm gain 
that Is less than unity. Alternatively, it may be desirable to achieve a fast-attack to correct utilization excesses and/or 
10 achieve a sfow-increase of the carried traffic when the utilization is nearing the target value. In such a case, split gain 
may be used. In addition, the gain and filtering module 619 provides reconciliation of any differences In the operating 
intervals or units employed between the BCP 611 and the scheduler 603. 

[0063] Thereafter the Control Value is computed from the Correction value. The output of the gain and filtering 
module 619 (which is the Correction value) is input to an adder 621 . 
'5 The Control Value that is output from the adder 621 Is based on the following: 



New Control Value = Reference Control Value + Correction Value. Eq.(8) 

20 The Reference Control Value is the Control Value that was previously transmitted to the BCP 611 during the measure- 
ment period that produced the metrics that were used In deriving the current Correction value. A key value for facilitating 
this correlation is that of a Round-Trip Control Time (RTCT). This RTCT is the time between successive, causal ad- 
justments in the Control Values. The RTCT includes all causal delays in one round trip of the control loop; e.g., prop- 
agation delays, message transmission/reception delays, message processing delays, the measurement period, etc. 

25 [0064] For Reference Control Value lookup purposes, in one embodiment of the present invention, the RTCT value 
is convened into an index value that represents how many Control Value messages ago that the Reference Control 
Value was sent out. In the case in which the Control Value messages are sent out at regular intervals, and for which 
RTCT seconds known, the index Is computed as follows: 

30 

RTCT = Int. [RTCT ^^^^^/ Interval J, Eq.{9) 

where Int. [ ] represents the value of the division, wherein any fractional part is rounded up to the next integer. For 
example, if the RTCT is 1 .7 seconds, and the message interval is 0.5 seconds, then RTCT ,^0^ equals 4. 
55 [0065] However, if the RTCT is not constant or is otherwise uncertain, then an adaptive approach Is used to obtain 
either the Reference Control Values or RTCT ^^tdex- The Reference Control Values may be obtained from the BCP 611 
by reading those control values that were active during the measurement period. The BCP 61 1 sends the appropriate 
prior control values to the traffic control processing logic 613 along with the current bandwidth metrics. Under this 
approach, the control storage 623 is not required. This approach is particularly effective when the traffic control process- 
ing logic 613 is collocated with the scheduled 603. If the traffic control processing logic 613 is not collocated with the 
scheduler 603 (e.g., ground based), then storing the values locally within the traffic control processing logic 613 may 
be preferable, as this may represent a significant amount of control information. 

[0066] In step 711 , the Correction value is applied to a selected, previously stored Control Value for the microcell to 
produce a new Control Value for the particular microcell. On the other hand, if the difference falls within the predeter- 
mined range that corresponds to zero error, then the new Control Value is set to the previous Control Value (step 713). 
The New Control Value Is stored for later use in control storage 623, per step 715. 

[0067] According to an embodiment of the present invention, the control storage Index can be dynamically determined 
without the requirement that the RTCT be known or constant. As the gain and filtering module 619 produces the Cor- 
rection values, the module 619 also produces Control Sequence Numbers (CSNs) to correspond to the new Control 

5^ Values. The CSNs follow a modulo-n function (i.e., the numbering is cyclic). The CSN is stored in the control storage 
623 and is sent to the BCP 611, which also stores the CSN locally. When the bandwidth metrics are detennined by 
scheduler 603. scheduler 603 also reads the value of the CSN that Is associated with the measurement period. Sched- 
uler 603 includes the CSN with the metrics in the message that is transmitted to the traffic control processing logic 
613. Thus, when the Correction values arc determined from those metrics, as in step 709. the respective CSNs are 

55 employed as indices into a table within the control storage 623, yielding the proper Reference Control Values, to be 
employed by the adder 621 . 

[0068] In step 71 7, the Control Value is sent within a message to the BCP 611 in the satellite 601 . Accordingly, the 
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BCP 611 regulates the uplink traffic from the transmitting STs, per step 719, such that, during any one bandwidth 
allocation period, the traffic authorized by the BCP 61 1 for any particular microcell does not exceed the limit established 
by the traffic control processing logic 61 3 for that microcell. It is noted that the actual traffic admined to the switch 609 
and stored in the queue 607 for for a particular microcell may be less than the limit authorized by the traffic control 
5 processing logic 613 if the aggregate transmitting ST demand to the microcell is less than this limit (as specified by 
the Control Value). 

[0069] The scheduler 603 responds adaptively, assigning bandwidth as may be available to those microcells whose 
queues contain traffic. For some microcells, the scheduler 603 may have additional bandwidth available beyond that 
of the actual carried traffic for the microcell. The monitoring function of the scheduler 603 collects and reports, at least, 
10 the carried and available bandwidth for each microcell of interest, Initiating a repeat of the steps 701 -71 9 for each such 
microcell, 

[0070] As part of a traffic control loop, the traffic control processing logic 613 is stable at unity gain for which, in 
response to a transient, the logic 61 3 exhibits neither overshoot nor undershoot. It is observed that a causal correction 
cannot be made faster than one RTCT The traffic control processing logic 613 advantageously provides 100% of the 

'5 indicated correction in exactly one RTCT with stable loop operation. This characteristic of the present invention provides 
a major improvement over conventional systems. Given its adaptive capability, the traff ic control processing logic 613 
is well-suited for bursty traffic whose bandwidth needs are not known in advance. That is, no prior assumptions as to 
traffic profiles or patterns are required for the operation of the traffic control processing logic 613. Consequently, the 
traffic control processing logic 613 is also adaptive to the presence of allocated traffic. This transparency to the traffic 

20 pattern advantageously enhances operation of communication system 600, by significantly reducing, for example, the 
operational load on a system operator. 

[0071] To better appreciate the present invention, it is instructive to analyze the performance of the ABCI^. The 
transient performance of the closed-loop traffic control algorithm of Figure 6 significantly Impacts the system perform- 
ance. The transient performance is characterized by a combination of the speed of response, post-transient stability 

25 Including lack of any ringing, and accuracy in maintaining the desired bandwidth limit when subjected to varying degrees 
of available bandwidth and of the actual traffic due to any traffic allocations. If the loop responds too slowly, then any 
sudden decrease in bandwidth available to a queue 605 may result in an unacceptable amount of packet loss stemming 
from queue overflow. Conversely, if additional bandwidth suddenly becomes available, and the loop is slow to react, 
then this temporarily available bandwidth may be lost to the system 600. This dynamic behavior is largely dependent 

30 on the gain and reference mechanisms employed, the control loop's RTCT, and the values for the several gain param- 
eters to be employed. 

[0072] The overall loop gain is the product of two gains: the algorithm gain and a message gain. For the system of 
Figure 6, the algorithm gain is that of module 619. One simple, but effective implementation of the gain function for 
module 619 is to relate the Error of Eq. (7) with the Correction Value of Eq. (9) by a simple linear factor: 



35 



45 



Correction Value = Gain * Error Eq.(9) 



This Gain parameter basically determines the speed with which the bandwidth control limits are updated in response 
^0 to a transient. Conceptually, a simple, but effdttive form of bandwidth adjustment is obtained by combining Eq. (9) with 
Eq. (7) to obtain: 



New Control Value = Reference Control Value + Gain * Error Eq.(IO) 



Ideally, one would like the Gain of Eq. (1 0) to be unity (i.e., 1 .00). With unity gain, when an error is observed, the Control 
Values are corrected promptly and exactly (within measurement errors). However, unless a proper selection is made 
for the Reference Control Value, the post-transient response can be badly impaired, and even become unstable, with 
unity Gain due to the message gain effect. Conceptually, the message gain is an integer that equals the number of 

so outstanding messages in the traffic control loop rounded up to the nearest whole message. This gain effect is dependent 
on both the RTCT and the message update interval for the bandwidth control loop of a system such as 600. For ground- 
based control of satellite bandwidth, RTCT is typically about 1 .5 to 2 seconds, and message intervals typically range 
from 250 to 750 msec, yielding message gains of typically 3 to 6. However, this message gain effect can be nullified 
by appropriate Implementation of the teachings of this invention, in particular, the employment of an appropriate se- 

55 lection for the Reference Control Value as with ABCM. 

[0073] The ABCI^ mechanism avoids the message gain effect and provides stability of the traffic control loop by 
correlating the appropriate Reference Control Values (RCVs) with the respective measurement periods. ABCM makes 
direct, immediate bandwidth changes and thereby provides for an ideal transient response. In other words, it is desirable 
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lo make an immediate correction to any indicated changes, in which 1 00% of the indicated correction (error) is made 
in one step, and at one RTCT. The ABCM mechanism is further described, as follows: 

^ New Control Value = RCV + Correction Value = RCVj + Funciion(Measurementj) Eq-(ll) 

where, j designates some particular RCV and the bandwidth measurements resulting from this RCV. As evident 
from Eq. (11). the RCV that is to be used is not that of the previous value of New Control Value, but rather that of the 
New Control Value that was active when the measurement was made. This correlation may be facilitated by means 

10 such as Control Storage 623. Under this approach, the Gain parameter can be set to 1 00% with complete closed-loop 
stability. As a result. 1 00% of the indicated correction can be made in a single correction step, with zero overshoot and 
zero undershoot • thus obtaining an ideal transient response. Furthermore, Eq. (11) is Independent of the RTCT 
[0074] Figure 8 shows a diagram of the scheduler of Figure 5 utilizing four counters for collecting the bandwidth 
metrics, in accordance with an embodiment of the present invention. Scheduler 603 includes a counter logic 801 that 

15 controls the incrementing and decrementing of a Skip counter 803, a Block counter 805, a Yes counter 807, and a No 
counter 809. These scheduler counters 803.. 805, 807, and 809 provide a mechanism to collect performance metrics. 
[0075] Several reasons exist to monitor the performance of the scheduler 603. A first metric Is lo measure periodically 
the amount of traffic actually assigned to each microcell (i.e., throughput). This throughput measurement, as will be 
more fully descrt^ed later, can be determined at the salellile 505 or by separate ground-based STs 501 and 503 in 

20 each microcell. 

[0076] This throughput metric by itself provides insufficient information with respect to scheduler efficiency, which 
indicates the amount of the traff ic demand that is capable of being assigned - considering all of the real-time restrictions 
- is actually being assigned. Additionally, each mechanism of the scheduler 603 that enforces a restriction may have 
some degree of adjustability in meeting the requirement. Making such adjustments to the scheduler 603 mechanisms 

25 in an optimum manner requires additional information (i.e., metrics) as to the operation of the scheduler 603 - on a 
mk:rocell-by-mtcrocelt basis. In particular, information relating to Ingress traffic to the queues 607 is helpful in preventing 
queue overflow. If congestion arises at the queues 607, overflow will result in lost traffic for the microcells corresponding 
to the overflowed queue. Accordingly, control of the traffic to some or all such microcells is needed by detemnining the 
amount of bandwidth that is available for assignment to the microcells, not just the actual traffic assigned. For example, 

30 the amount of traffic that is controlled at the source results in a particular microcell receiving 50 Mbps, as regulated by 
the scheduler 603. 

[0077] The throughput to the particular microcell may be dictated by the following scenarios. Under the first scenario, 
scheduler 603 has 52 Mbps available, with 50 Mbps being currently used. This situation indicates a normal operating 
point - approximately 96% utilization of available bandwidth; thus, no corrective action needs to be taken. In a second 
35 possible scenario, the scheduler 603 has 70 Mbps available, but only 50 Mbps is currently being demanded and used. 
In a third scenario, scheduler 603 has 70 Mbps available, in which only 50 Mbps is being currently used. However, the 
traffic demand is for 65 Mbps. In such a case, the scheduler 603 needs to make adjustments to Increase utilization via 
the ABCM. To make these necessary adjustments, additional metrics relating to the operation of the scheduler 603 Is 
required. 

40 [0078] Figure 9 shows a flowchart of the scheduler monitoring operation, according to an embodiment of the present 
invention. At the beginning of each measurement period, the counter values associated with a particular queue (mi- 
crocell) are either noted or are initialized to a known value (e.g., zero), per step 901 . The scheduler 603 monitors its 
own operation by utilizing the four counters 803, 805, 807, and 809 for each microcell (that requires monitoring). The 
counter logic 801 monitors the state of each of the subject queues 607, and increments the appropriate counters 803, 

45 805, 807, and 809 (per step 903). Next, the control logic 801, as in step 905, determines whether the measurement 
period has expired. If the measurement period has not expired, then step 903 is repeated until the measurement period 
does expire. Upon expiration of the measurement period, the traffic control processing logic 613 retrieves the counter 
values, per step 907, and computes the scheduler perfomnance metrics (step 909). The operation of control logic 801 
is discussed more fully in Figure 10. 

50 [0079] Figure 10 is a flowchart of the metric collection process using the counters of Figure 8, according to an em- 
bodiment of the present invention. In step 1 001 , control logic 801 determines whether the queue 607 has been skipped 
by the scheduler 603. The queue 607 may be skipped for a number of reasons, such as implementation of a policy. 
The control logic 801 increments the Skip counter 803 in this instance (step 1 003) and exits. Else, as in step 1005 the 
control logic 801 determines whether the queue 607 is blocked by a previous assignment to one or more other microcell 

55 (s): if so. control logic 801 , as in step 1007, increments the Block counter 805 and exits. Else, as in step 1 009, control 
logic 801 checks whether the queue 607 is ready for assignment. If queue 607 is not ready, then the No counter 807 
is incremented, per step 1011, andexlts. That Is, the queue 607 has nothing to send, and thus, the scheduler 603 has 
made no assignment. If the queue 607 is ready for assignment (as determined by control logic 801), then the Yes 
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counter BOP is incremented (step 1013). 

[0080] Thereafter, at some measurement period. Time, the counters 803, 805, 807, and 809, are read for each 
microcell (step 907). and another measurement interval is started. These measurement results (metrics) are sent to 
one (or more) facilities to evaluate the scheduler 603 performance. 
5 [0081] A variety of derived scheduler 603 performance metrics may be obtained from the four metrics corresponding 
to the four counters 803. 805, 807, and 809. 

Throughput = Yes / Time Eq.(12) 

10 

Extra bandwidth available = No / Time Eq.(13) 
Total bandwidth available = (Yes + No) / Time Eq.(1 4) 

Percent utilization of available bandwidth = 100% * Yes /(Yes + No) Eq.(15) 

20 

Scheduling rate = (Block + Yes + No) / Time Eq.(16) 
Percent blocking = 1 00% * Block /(Block + Yes + No) Eq.( 1 7) 

25 

Percent skipping = 100% * Skip /Total Eq.(18) 

where 

30 

Total = Skip + Block + Yes + No. 



[0082] Depending on the adjustment and control capabilities desired, not all of the four counters 803, 805. 807. and 

35 809 (per microcell) need to be implemented in a specific design. As indicated by Eq. (12), implementation of the Yes 
counters 809 provides the basic throughput metric (which is also available by ground^based mechanisms). All of the 
remaining secondary metrics are very difficult or impractical to achieve with ground-based mechanisms. The addition 
of the No counter 807 (per microcell) pennits determination of the effectiveness of the traffic control measures taken, 
and may also serve as a real-time input metric for the ABCM, using, for example, Eqs. (13) - (15). 

40 [0083] Eq. (1 5) provides the basis for design of a mechanism for detennining the actual utilization of a queue in terms 
of its egress traffic. According to one embodiment of the present invention, enhanced operation may be obtained by 
modifying Eq. (15), as described below. Under certain circumstances, in which there is either a large, abrupt increase 
in traffic that is offered to the queue and/or a large abrupt, decrease in the bandwidth available for the egress traffic (L 
e.. a sudden drop in the queue exit traffic rate), Eq. (1 5) can be altered to account for such conditions. For the purposes 

45 of illuslralion of the scenario involving an abrupt decrease in the available bandwidth of system 600, the following 
assumptions are made: the Target utilization value is 95%, the available bandwidth is 200 kpps, and the queue is in 
steady state whereby the actual utilization, as given by Eq. (15), equals the Target value set for it (i.e., the Error is 
zero). Given a queue input of 190 kpps, a sub-system failure may cause the available bandwidth to abruptly drop to 
140 kpps. As a result, the actual queue utilization rises to 100%, with an indicated percentage Error of- 5% (95% - 

50 1 00%). Using Eq. (7), the Error becomes ♦ 7.6 kpps; i.e., (95/100) * (140 + 0) - (140), leading to a New Control Value 
of 1 82.4 kpps (1 90 - 7.6). This adjustment may be inadequate under this circumstance as the desired control value for 
95% utilization is 133 kpps (95/100 * 140). This potential deficiency stems from the fact that the measured utilization 
is capped out at 100%. To address this situation, the concept of an "offered" utilization is defined as follows: 

55 

Offered Utilization = 1 00% ♦ Offered Jo__queue / (Yes + No) Eq.(1 9) 

Introducing this concept into Eq. (7) yields the following Error calculation: 
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Error = (Target/100) (Yes + No) - Offeredjo_queue Eq.(20) 

Continuing with the above example, using Eq. (20) rather than Eq. (7). the Error Is - 57 kpps (I.e., (95/100)* (140 + 0) 
5 - (190)). This new Error calculation provides a New Control Value of 133 (190 - 57), which Is the correct value. 

[0084] For cases In which the Offered_to_queue Is unknown, an approximation to Eq. (20) may be obtained by 
replacing Offered_to_queue with (Yes + Loss), where Loss is the input loss rate to the queue due to queue overflow, 
assuming that Loss Is in the same units as Yes and No: 

10 

Error = (Targel/1 00) * (Yes + No) - (Yes + Loss) Eq.(21) 

During operation at high load but without congestion, the Loss will be zero and No value will be small (but non-zero). 
By contrast, in the case in which an abrupt and large decrease In available bandwidth is experienced, the No variable 
15 is zero and Loss is a significant value. 

[0085] Module 613 may employ mechanisms for Eqs. (19), (20) and/or (21) for the situations in which higher per- 
formance of system 600 is required. In such a case, module 609 may supply the Offered_to_queue or Loss metrics to 
613, in addition to the Yes and No metrics that are furnished by module 603. 

[0086] A measurement of system fairness may be obtained by comparing the results of Eq. (14) for one microcell 
20 with that of the other microcells. However, any resulting unfairness may be the result of the (necessary) assignment 
restrictions that the scheduler 603 may need to exert. For this situation, a measurement of scheduler fairness may be 
obtained by incorporating the Block counter 805 and comparing the results of Eq. (16) for one microcell with that of 
the others. If the results of Eq. (17) appear to be too high for certain microcells, then the particular scheduler 603 
algorithms may require adjustment, particularly if other microcells arc receiving too little traffic. 
25 [0087] Inclusion of a Skip counter 803 or equivalent metric is helpful in ascertaining the results and effectiveness of 
any deliberate weighting functions that may be employed in the scheduling algorithms. 

[0088] Extensions to the above metrics may be utilized, depending on the applications. For example, additional 
counters may be employed for diagnostic purposes; a number of counters could be designated to explicitly Indicate 
the various causes of blocking. It should be noted that the measurement period could be designated differently for 
30 different counters. If real-time control Is not -required with respect to blocking and skipping, then the interval at which 
these are metrics are measured can be significantly increased compared to those counters that are used for real time 
measurements (e.g., Yes and No counters 809 and 807). In this case, suitable time aggregation of the blocking and 
skipping counter values would be employed for use in Eqs. (16) - (18). 

[0089] Figure 11 illustrates a computer system 1101 upon which an embodiment according to the present invention 
35 may be implemented to perform congestion avoidance. Computer system 1101 Includes a bus 1 1 03 or other commu- 
nication mechanism for communicating infonnationj and a processor 1105 coupled with bus 1103 for processing the 
infonnation. Computer system 1101 also includes a main memory 1107, such as a random access memory (RAM) or 
other dynamic storage device, coupled to bus 1 1 03 for storing Information and instructions to be executed by processor 
1105. In addition, main memory 1107 may be used for storing temporary variables or other intermediate information 
40 during execution of instructions to be execute by processor 1 1 05. Computer system 1 1 01 further includes a read only 
memory (ROM) 1109 or other static storage device coupled to bus 1103 for storing static information and instructions 
for processor 1105. A storage device 1111, such as a magnetic disk or optical disk, is provided and coupled to bus 
1103 for storing information and instructions. 

[0090] Computer system 1101 may be coupled via bus 1103 to a display 1113, such as a cathode ray tube (CRT), 
^5 for displaying infonnation to a computer user. An input device 1115, including alphanumeric and other keys, is coupled 
to bus 1103 for communicating information and command selections to processor 1105. Another type of user input 
device Is cursor control 1117, such as a mouse, a trackball, or cursor direction keys for communicating direction infor- 
mation and command selections to processor 11 05 and for controlling cursor movement on display 1113. 
[0091] According to one embodiment, the traffic control processing logic 613 (Figure 6) is performed by computer 
50 system 1101 in response to processor 1105 executing one or more sequences of one or more Instructions contained 
In main memory 1 1 07. Such instructions may be read into main memory 1 1 07 from another computer-readable medium, 
such as storage device 1111. Execution of the sequences of instructions contained in main memory 1107 causes 
processor 11 05 to perfomn the process steps described herein. One or more processors in a multi-processing arrange- 
ment may also be employed to execute the sequences of instructions contained in main memory 1107. In alternative 
55 embodiments, hard-wired circuitry may be used in place of or In combination with software instructions. Thus, embod- 
iments are not limited to any specific combination of hardware circuitry and software. 

[0092] Further the congestion avoidance mechanism of the present invention may reside on a computer-readable 
medium. The temn "computer-readable medium" as used herein refers to any medium that participates in providing 
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instructions to processor 1105 for execution. Such a medtuni may take many forms, including but not limited to, non- 
volatile media, volatile media, and transmission media. Non-volatile media includes, for example, optical or magnetic 
disks, such as storage device 1111. Volatile media includes dynamic memory, such as main memory 1 1 07. Transmission 
media includes coaxial cables, copper wire and fiber optics, including the wires that comprise bus 1103. Transmission 
5 media can also take the form of acoustic or light waves, such as those generated during radio wave and infrared data 
communication. 

[0093] Common forms of computer-readable media include, for example, a floppy disk, a flexible disk, hard disk, 
magnetic tape, or any other magnetic medium, a CD-ROM, any other optical medium, punch cards, paper tape, any 
other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory 

10 chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read. 

[0094] Various forms of computer readable media may be Involved In carrying one or more sequences of one or 
more Instructions to processor 1 1 05 for execution. For example^ the instructions may initially be carried on a magnetic 
disk of a remote computer. The remote computer can load the instructions relating to the notification services to control 
call processing remotely into its dynamic memory and send the Instructions over a telephone line using a modem. A 

15 modem local to computer system 1101 can receive the data on the telephone line and use an Infrared transmitter to 
convert the data to an Infrared signal. An infrared detector coupled to bus 1103 can receive the data carried In the 
Infrared signal and place the data on bus 1103. Bus 1103 carries the data to main memory 1107, from which processor 
1 1 05 retrieves and executes the Instructions. The instructions received by main memory 1 1 07 may optionally be stored 
on storage device 1111 either before or after execution by processor 1105. 

20 [0095] Computer system 1101 also includes a communication interface 1119 coupled to bus 1103. Communication 
interface 1119 provides a two-way data communication coupling to a network link 1121 that Is connected to a local 
network 1123. For example, communication interface 1119 may be a network interface card to attach to any packet 
switched local area network (LAN). As another example, communication interface 1119 may be an asymmetrical digital 
subscriber line (ADSL) card, an integrated services digital network (ISDN) card or a modem to provide a data commu- 

25 nicatlon connection to a corresponding type of telephone line. Wireless links may also be implemented. In any such 
implementation, communication interface 1119 sends and receives electrical, electromagnetic or optical signals that 
carry digital data streams representing various types of infonnation. 

[0096] Network link 1 1 21 typically provides data communication through one or more networks to other data devices. 
For example, network link 1121 may provide a connection through local network 1123 to a host computer 1125 or to 

30 data equipment operated by a service provider, which provides data communication services through a communication 
network 1127 (e.g., the Internet). LAN 1123 and network 1127 both use electrical, electromagnetic or optical signals 
that carry digital data streams. The signals through the various networks and the signals on network link 1121 and 
through communication interface 1119, which carry the digital data to and from computer system 1101, are exemplary 
forms of carrier waves transporting the information. Computer system 1101 can transmit notifications and receive data, 

35 Including program code, through the network(s), network link 1121 and communication interface 1119. 

[0097] The techniques described herein provide several advantages over prior approaches to avoiding traffic con- 
gestion. A scheduler 61 3 generates bandwidth metrics for a destination region (e.g. , microcell). A traffic control process- 
ing logic 613 receives the bandwidth metrics. The traffic control processing logic 613 includes a utilization module 615 
that determines utilization associated with the destination site based upon the received bandwidth metrics, and an 

40 error calculation module 61 7 that computes the difference between the detennined utilization and a target utilization. 
A gain and filtering module 619, which Is also a part of the traffic control processing logic 613, computes a Correction 
value based upon the difference between the determined utilization and the target utilization, in which the Correction 
value being associated with the destination site. Further the traffic control processing logic 613 includes an adder 621 
that outputs a Control Value based upon a Reference Control Value and the Correction value. A bandwidth control 

45 processor 611 assigns bandwidth allocation based upon the control value. This approach advantageously provides 
enhanced system efficiency. Another advantage Is that this arrangement optimizes system throughput. 
[0098] Obviously, numerous modifications and variations of the present invention are possible in lighl of the above 
teachings. It is therefore to be understood that within the scope of the appended claims, the invention may be practiced 
othenvise than as specifically described herein. 

50 

Claims 

1. A method of measuring scheduler efficiency, the method comprising: 

55 

selectively incrementing a plurality of scheduler counters (803. 805,. 807, and 809) corresponding to a plurality 
of scheduling events; and 

computing performance metrics based upon values of the plurality of scheduler counters (803. 805. 807, and 



EP1 162 790 A2 



809). 

2. The method according lo Claim 1 . wherein the performance metrics in the computing step comprises at least one 
of throughput, extra bandwidth available, total bandwidth available, percent utilization of available bandwidth, 

5 scheduling rate, percent blocking, and percent skipping. 

3. The method according to Claim 1 , further comprising: 

sending the counter values to a remote processor (508). 

10 • 4. The method according to Claim 1 , wherein the plurality of scheduler counters (803, 805, 807, and 809) in the step 
of selectively incrementing comprise a skip assignment counter associated with a scheduling event Indicating that 
the scheduler (603) has skipped assignment for transmission, a blocked assignment counter associated with a 
scheduling event indicating that the scheduler (603) has blocked assignment for transmission, a No counter (807) 
associated with a scheduling event indicating that a queue (607) is not ready for assignment, and a Yes counter 

15 (809) associated with a scheduling event indicating that the queue (607) is ready for assignment. 

5. The method according to Claim 4, wherein the computing step comprises: 

compulmg throughput based upon a value of the Yes counter (809); 
20 computing extra bandwidth available based upon a value of the No counter (807); 

computing total bandwidth available based upon the value of the Yes counter (809) and the value of the No 
counter (807); 

computing percent utilization of available bandwidth based upon the value of the Yes counter (809) and the 
value of the No counter (807); 

25 computing scheduling rate based upon a value of the block counter (805). the value of the Yes counter (809).. 

and the value of the No counter (807); 

computing percent blocking based upon the value of the block counter (805), the value of the Yes counter 
(809), and the value of the No counter (807); and 

computing percent skipping based upon a value of the skip counter (803). 

30 

6. The method according to Claim 4, wherein the computing step comprises: 

computing percent of offered utilization of available bandwidth based upon the value of the Yes counter (809), 
the value of the No counter (807), and an Offered-to-Queue value that reflects amount of traffic from a plurality of 
queues (607). 

35 

7. The method according to Claim 4, wherein the scheduler (603) regulates transmission to a microcell, the skip 
counter (803), the block counter (805), the No counter (807), and the Yes counter (809) being associated with the 
microcell. 

"10 8. The method according to Claim 1 , whereSn the plurality of scheduler counters (803, 805, 807, and 809) in the step 
of selectively Incrementing include diagnostic counters to Indicate causes of blocking. 

9. A scheduling device having metrics measurement capability, comprising: 

45 a plurality of scheduler counters (803. 805, 807, and 809) corresponding to a plurality of scheduling events; and 

a counter logic (801) configured to selectively increment the plurality, of scheduler counters (803, 805, 807, 
and 809), the counter logic (801) being coupled to a plurality of queues (607) that store cells, 

wherein perfomnance metrics are computed based upon values of the plurality of scheduler counters (803, 
50 805. 807, and 809). 

10. The device according to Claim 9, wherein the performance metrics comprises at least one of throughput, extra 
bandwidth available, total bandwidth available, percent utilization of available bandwidth, scheduling rate, percent 
blocking, and percent skipping. 

55 

11. The device according to Claim 9, wherein the counter values are transmitted to a remote processor (508). 

12. The device according to Claim 9, wherein the plurality of scheduler counters (803, 805. 807. and 809) comprise 
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a skip assignment counter associated with a scheduling event indicating that the scheduler (603) has skipped 
assignnrient for transmission, a block counter (805) associated with a scheduling event indicating that the scheduler 
(603) has blocked assignment for transmission, a No counter (807) associated with a scheduling event indicating 
that a queue (607) is empty, and a Yes counter (809) associated with a scheduling event indicating that the queue 
5 (607) is not empty. 

13. The device according to Claim 12, wherein the performance metrics comprises throughput that is computed based 
upon a value of the Yes counter (809); extra bandwidth available that is computed based upon a value of the No 
counter (807); total bandwidth available that is computed based upon the value of the Yes counter (809) and the 

to value of the No counter (807); percent utilization of available bandwidth that is computed bandwidth based upon 

the value of the Yes counter (809) and the value of the No counter (807); scheduling rate that is computed based 
upon a value of the block counter (805), the value of the Yes counter (809). and the value of the No counter (807); 
percent blocking that is computed blocking based upon the value of the block counter (805), the value of the Yes 
counter (809), and the value of the No counter (807); and percent skipping that is computed based upon a value 

»5 of the skip counter (803). 

14. The device according to Claim 12, wherein the perfomriance metrics comprises percent of offered utilization of 
available bandwidth based upon the value of the Yes counter (809)^ the value of the No counter (807), and an 
Offered-lo-Qweue value that reflects amount of traffic from the plurality of queues (607). 

20 

15. The device according to Claim 12, wherein the scheduling device regulates transmission to a microcell, the skip 
counter (803), the block counter (805).. the No counter (807), and the Yes counter (809) being associated with the 
microcell. 

25 16. The device according to Claim 9, wherein the plurality of scheduler counters (803, 805, 807, and 809) include 
diagnostic counters to indicate causes of blocking. 

17. A switching system comprising: 

30 a plurality of input ports (101) configured to receive cells; 

a plurality of output ports (113) communicating with a plurality of destination sites: and 

a plurality of queues (607) coupled to the input ports (101) and the output ports (113) for storing the received 

cells; and 

a scheduler (603) coupled to the plurality of queues (607) and configured to assign the stored cells for trans- 
35 mission out the output ports (113), the scheduler (603) comprising, 

a plurality of scheduler counters (803, 805, 807, and 809) corresponding to a plurality of scheduling events, and 
a counter logic (801) configured to selectively increment the plurality of scheduler counters (803, 805, 807, 
and 809); and 

a processor (508) configured to compute perfomnance metrics based upon values of the plurality of scheduler 
^0 counters (803, 805, 807, and 809). S 

18. The system according to Claim 17, wherein the perfomnance metrics comprises at least one of throughput, extra 
bandwidth available, total bandwidth available, percent utilization of available bandwidth, scheduling rate, percent 
blocking, and percent skipping. 

45 

19. The system according to Claim 1 7, wherein the processor (508) is located remotely from the scheduler (603). 

20. The system according to Claim 1 7, wherein the plurality of scheduler counters (803, 805, 807, and 809) comprise 
a skip assignment counter associated with a scheduling event indicating that the scheduler (603) has skipped 

50 assignment for transmission, a block counter (805) associated with a scheduling event indicating that the scheduler 

(603) has blocked assignment for transmission, a No counter (807) associated with a scheduling event indicating 
that a queue (607) is empty, and a Yes counter (809) associated with a scheduling event indicating that the queue 
(607) is not empty. 

55 21 . The system according to Claim 20, wherein the perfonmance metrics comprises throughput that is computed based 
upon a value of the Yes counter (809); extra bandwidth available that is computed based upon a value of the No 
counter (807); total bandwidth available that Is computed based upon the value of the Yes counter (809) and the 
value of the No counter (807); percent utilization of available bandwidth that is computed bandwidth based upon 
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the value of the Yes counter (809) and the value of the No counter (807); scheduling rate that is computed based 
upon a value of the block counter (805), the value of the Yes counter (809), and the value of the No counter (807): 
percent blocking that is connputed blocking based upon the value of the block counter (805), the value of the Yes 
counter (809), and the value of the No counter (807); and percent skipping that is computed based upon a value 
5 of the skip counter (803). 

22. The system according to Claim 20, wherein the scheduler (603) regulates transmission to a microcetl, the skip 
counter (803). the block counter (805), the No counter (807), and the Yes counter (809) being associated with the 
microcell. 

10 

23. The system according to Claim 20, wherein the performance metrics comprises percent of offered utilization of 
available bandwidth based upon the value of the Yes counter (809), the value of the No counter (807), and an 
Offered-to-Queue value that reflects amount of traffic from the plurality of queues (607). 

^5 24. The system according to Claim 17. wherein the plurality of scheduler counters (803, 805; 807, and 809) include 
diagnostic counters to indicate causes of blocking. 

25. A computer-readable medium carrying one or more sequences of one or more instructions for measuring scheduler 
efficiency, Ihe one or more sequences of one or more instructions including inslruclions which, when executed by 

20 one or more processors, cause the one or more processors to perform the steps of:" 

selectively incrementing a plurality of scheduler counters (803, 805, 807, and 809) corresponding to a plurality 
of scheduling events; and 

computing performance metrics based upon values of the plurality of scheduler counters (803, 805, 807. and 
25 809). 

26. The computer readable medium according to Claim 25, wherein the performance metrics in the computing step 
comprises at least one of throughput, extra bandwidth available, total bandwidth available, percent utilization of 
available bandwidth, scheduling rate, percent blocking, and percent skipping. 

30 

27. The computer readable medium according to Claim 25. further comprising computer-executable instructions for 
causing the computer system to perform the steps of: 

sending the counter values to a remote processor (508). 

35 28. The computer readable medium according to Claim 25, wherein the plurality of scheduler counters (803, 805, 807, 
and 809) in the step of selectively incrementing comprise a skip assignment counter associated with a scheduling 
event indicating that the scheduler (603) has skipped assignment for transmission, a block counter (805) associated 
with a scheduling event Indicating that the scheduler (603) has blocked assignment for transmission, a No counter 
(807) associated with a scheduling event indicating that a queue (607) is empty, and a Yes counter (809) associated 
with a scheduling event indicating that the queue (607) is not empty. 

29. The computer readable medium according to Claim 28, further comprising computer-executable Instructions for 
causing the computer system to perfomn the steps of: 

^5 computing throughput based upon a value of the Yes counter (809); 

computing extra bandwidth available based upon a value of the No counter (807); 

compuling total bandwidth available based upon the value of the Yes counter (809) and the value of the No 
counter (807); 

computing percent utilization of available bandwidth based upon the value of the Yes counter (809) and the 
50 value of the No counter (807); 

computing scheduling rate based upon a value of the block counter (805)^ the value of the Yes counter (809), 
and the value of the No counter (807); 

computing percent blocking based upon the value of the block counter (805), the value of the Yes counter 
(809), and the value of the No counter (807); and 
55 computing percent skipping based upon a value of the skip counter (803). 

30. The computer readable medium according to Claim 28, wherein the scheduler (603) regulates transmission to a 
microcell. the skip counter (803). the block counter (805), the No counter (807), and the Yes counter (809) being 
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associated with the microcell. 

31 . The computer readable medium according to Claim 25, wherein the plurality of scheduler counters (803, 805, 807, 
and 809) in the step of selectively incrementing include diagnostic counters to indicate causes of blocking. 

32. The computer readable medium according to Claim 28, wherein the computing step comprises: 

computing percent of offered utilization of available bandwidth based upon the value of the Yes counter (809), 
the value of the No counter (807), and an Offered-to-Queue value that reflects amount of traffic from a plurality of 
queues (607). 
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